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(54) Method for address lookup 

(57) An efficient method of storing prefixes related 
to addresses in a binary trie fashion wherein no each 
node in the tree has a prefix stored in it and no node is 
empty. Methods for searching, inserting and deleting. A 
network system with prefixes of network addresses 
stored in a binary trie fashion wherein no each node in 
the tree has a prefix stored in it and no node is empty. 
Fast longest matching prefix lookup, efficient memory 
usage (one node per prefix), and fully dynamic opera- 
tion are supported. A greedy algorithm that calculates 
the binary trie of the present invention with minimum 
overall depth. A dynamic programming approach that 
constructs the binary trie of the present invention with 
the minimal expected number of search steps, based on 
an arbitrary distribution of destination IP addresses. A 
pipelined hardware structure for the binary trie of the 
present invention, providing a throughput of one longest 
prefix match per memory access time, with insert and 
delete operations requiring no more than two clock 
cycle stalls in the pipeline. 
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Description 

IA. Field of the invention 

5 [0001] This invention relates to storing prefixes related to addresses efficiently. Specifically, this invention relates to 
storing prefixes related to addresses in a binary trie fashion wherein each node in the trie has a prefix stored and no 
node is empty. The present invention is embodied in a method of storing prefixes related to addresses in a binary trie 
fashion; in a method of storing prefixes related to network addresses in a binary trie fashion wherein each node in the 
trie has a prefix stored and no node is empty; in a networking system where network addresses are stored in a binary 

w trie fashion wherein each node in the trie has a prefix stored and no node is empty, and a computer program product 
which enables a computer to store addresses in a binary trie fashion wherein each node in the trie has a prefix stored 
and no node is empty. 

IB. Background of the Invention 

75 

[0002] Storing addresses and prefixes related to addresses efficiently is important for any system that uses multiple 
addresses, it should be noted that this background section discusses forwarding tables associated with routers used in 
many Internet applications. However, the techniques and principles discussed apply to any system where a table is 
required to store prefixes related to multiple addresses. In networking systems, a large number of network addresses 

20 need to be stored efficiently. 

[0003] IP addresses typically have 32 bits. An IP datagram contains both a source and a destination IP address. At 
a router, an incoming IP datagram must be forwarded to the next to hop, which is typically some neighboring machine. 
The router decides the next hop by consulting it routing table. This procedure is called IP forwarding, or table lookup. It 
should be noted that forwarding is distinct from computing the routes, which can be call routing and is handled by rout- 

25 ing algorithm. IP forwarding is sometimes the most time-consuming task for a typical datagram. 

[0004] Forwarding of datagrams in recent versions of IP relies on the storage of a set of IP address prefixes, each 
address being associated with a next hop within the networking system using IP. When an IP datagram arrives at a 
router within the networking system, the destination address is matched against the prefixes stored in the forwarding 
table associated with the router. The longest prefix that matches the destination IP address is found, and the next-hop 

30 information associated with that prefix is used for forwarding the datagram. This problem is called the Longest Matching 
Prefix (LMP) problem. As can be readily appreciated, the efficient storage of prefixes related to addresses is an impor- 
tant factor in addressing the LMP problem. 

[0005J A conventional technique of storing prefixes in the forwarding table associated with a router in a networking 
system using IP is known as class-less Inter-Domain Routing (CIDR). See V. Fuller, T Li, J. Yu, and K. Varadhan, 

35 "Classless inter-domain routing (CIDR): An address assignment and aggregation strategy," RFC-1519, September 
1 993. The intent of this approach is to reduce the size of tables storing addresses within the Internet. The IP forwarding 
approaches prior to CDIR relied on fixing the address formats so that destination network number could easily be 
extracted. Datagrams were forwarded to the next hop associated with each destination network. One forwarding table 
entry per network is required on each router. Such a storage requirement became problematic as the number of net- 

40 works, on the Internet expanded. CIDR reduces the size of these forwarding tables by grouping IP addresses with the 
same next hop information under a single prefix, when such aggregation is possible. 



Prefix 


Next 




Hop 


0000 
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01100 
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1101 





TaUe 1 r An example of a forwarding table containing a set of 6 prefixes. 

55 

[0006] As an example of the above-mentioned forwarding process, consider Table 1 , which contains a set of pre- 
fixes, each associated with a next hop. (The next-hop information will typically consist of the next router's IP address 
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the outgoing physical interface.) For example, if an IP datagram has a destination address of "4.123.33. 12" , the leftmost 
eight bits are "00000100". For this address, the LMP from Table 1 is "0000", indicating a next hop of H 0 . Another exam- 
ple is destination address "109.12.12.12", with leftmost eight bits "01 101 101". This address matches both "01 101 " and 
"01 1 01 1 "; since the latter is the longer prefix, the next hop is H 3 . 

5 [0007] A significant amount of earlier research on information storage and retrieval is applicable to the LMP prob- 
lem, usually with only minor modifications. In particular, search approaches that rely on the binary representation of 
keys, rather than direct comparison of keys, have proven to be popular in this context. Knuth provides an overview of a 
variety of such "digital searching" approaches. See D. E. Knuth, The Art of Computer Programming: Volume 3, Sorting 
and Searching. Addison Wesley, second ed., 1998. 

w [0008] A trie structure is a kind of tree structure where branching at any level is determined by only a portion of the 
value stored in the nodes in the trie. Fredkin's trie structure is elegant, but suffers from inefficient memory usage, poten- 
tially requiring far more nodes than stored prefixes. See E. Fredkin, Trie memory," Communications of the ACM, vol. 3, 
pp. 490- 500, 1 960. Morrison's Patricia trie remedies this problem by removingeach trie node that is not associated with 
a table entrie and has only one child. See D. Morrison, "Patricia-practical algorithm to retrieve information coded in 

15 alphanumeric," Journal of the ACM, vol. 1 5, no. 4, pp. 51 5-534; October 1 968. These two structures, proposed by Fred- 
kin and Morrison. respectively, have influenced much of the recent work on IP forwarding. FIG. 19 shows an example of 
a conventional trie structure. FIG. 20 shows an example of a conventional trie structure and an equivalent conventional 
Patricia trie structure. In FIGs. 19-20, the darkened nodes store a prefix and the non-darkened nodes do not have any 
prefix stored. 

20 [0009] Recent proposals for dealing with IP forwarding have been optimized with different design goals in mind. 
Several of these approaches emphasize the speed of the lookup (i.e., search) rather than updates to the tables(i.e., 
insert and delete). See M. Degermark, A. Brodnik, S. Carlsson, and S. Pink, "Small forwarding tables for fast routing 
lookups," in Proceedings ACM SIGCOMM'97, pp. 3- 14, 1997; B. Lampson, V. Srinivasan, and G. Varghese, "IP 
lookups using multiway and multicolumn search," in Proceedings IEEE INFOCOM'98, pp. 1248- 1256, 1998; S. Nilsson 

25 and G. Karlsson, "Fast address lookup for Internet routers," in Proceedings of IEEE Broadband Communications 98, 
April 1998; H.H.-Y. Tzeng, "Longest prefix search using compresses trees," in GLOBE-COM'98, Global Internet Mini 
Conference, pp. 88-93, November 1998; and M. Waldvogel, G. Varghese, J. Turner, and B. Plattner, "Scalable high 
speed IP routing lookups," in Proceedings ACM SIGCOMM'97, pp. 25-36, 1 997. 

[0010] The reason for emphasizing the speed of the lookup is that although routing updates are fairly frequent, rout- 
30 ing protocols can take several minutes to accommodate an update; forwarding tables on any particular router do not 
need to be changed more than at most once per second for current systems. One therefore envisions the use of some 
dynamic routing table structure elsewhere on the router, which periodically updates the forwarding tables. 
[0011] The current emphasis on search speed leads to an unbalanced design, one that is out of step with current 
and future needs of the Internet. Labovitz et al., point out that Internet core routers typically exchanged between three 
35 to six million updates per day in 1996. See C. Labovitz, G. R. Malan, and F. Jahanian, "Internet routing instability," 
IEEE/ACM Transactions on Networking, vol. 6, no. 5, pp. 515-528, October 1998. As the Internet grows, and as support 
for mobility expands, an even greater need for forwarding tables that can be updated efficiently can be expected. 
[0012] Recently, there has been a flurry of work on the IP forwarding problem. In the present discussion, software 
approaches are emphasized. It ahould be noted that many software approaches can be implemented efficiently in hard- 
40 ware. One such hardware implementation of the present invention has also been provided. A comparison of several of 
these approaches can be found in the work of Filippe et al. See E. Filippi, V. Innocenti, and V. Vercellone, "Address 
lookup solutions for gigabit switch/router," in GLOBECOM'98, Global Internet Mini Conference, pp. 82-87, November 
1998. 

[001 3] Degermark et al. describe an approach optimized for execution on an off-the-shelf processor. To provide effi- 
45 cient operation, Dagermark et al keeps the table data small (so the entire forwarding table can fit into cache) while 
simultaneously trying to minimize the number of memory accesses required to search the table. See M. Degermark, A. 
Brodnik, S. Carlsson, and S. Pink, "Small forwarding tables for fast routing lookups," in Proceedings ACM SIG- 
COMM'97, pp. 3- 14, 1997. This way of storing reduces the number of memory accesses (at the expense of greater 
memory utilization) by searching the prefix tree (effectively a trie) only on three separate levels, as opposed to perform- 
50 ing one memory access for each of the 32 trie levels. In the prefix tree structure, only certain bit patters are possible at 
search of some level; Degermark et al. are therefore able to utilize a data compression technique. Though the gains in 
their example are somewhat limited (they can effectively store 1 6 bits of a bit vector with only 1 0 bits, and this is only for 
one component of the overall data structure), their compression approach is a notable one. This way of storing 
addresses is not designed to support efficient updates. 
55 [0014] Waldvogel et al. See M. Waldvogel, G. Varghese, J. Turner, and B. Plattner, "Scalable high speed IP routing 
lookups," in Proceedings ACM SIGCOMM'97, pp. 25-36, 1 997 describe another approach for searching a trie structure. 
Rather than starting at the root of the trie and working down, their approach starts at the middle level, and works up or 
down depending on the information it finds there. A level is searched quickly through hashing. Only nodes that would 
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be in the trie are stored. If a level is searched and no match is found, one knows that a smaller prefix is the only possi- 
bility. On the other band, a hit in the hash table could either mean the longest matching prefix has been found, or that 
one should look even deeper for a longer prefix. The key idea, however, is that not every level of the trie needs to be 
searched. The approach is quite scalable, requiring only 1gb level searches for b-bit prefixes. The selection of good 

5 hash functions-ones that can be calculated quickly and can evenly distribute the nodes-is not discussed herein, but is 
an important issue. Also, the structure makes heavy use of precomputation and does not support efficient updates. 
However, this approach is used on a specific IP router designed by Partridge et al. See C. Partridge, P. R Carvey, E. 
Burgess, I. Castineyra, T Clarke, L. Graham, M. Hathaway, P. Herman, A. King, S. Kohalmi, T. Ma, J. Mcallen, T. Men- 
dez, W. C. Milliken, R. Pettyjohn, J. Rokosz, J. Seeger, M. Sollins, S. Storch, B. Tober, G. D. Troxel, D. Waitzman, and 

7 0 S. Winterble, "A 50-Gb/s IP router," IEEE/ACM Transactions on Networking, vol. 6, no. 3, pp. 237-248, June 1998. >• 
[0015] Nilsson and Karlsson utilize a variation of a Patricia trie that replaces i complete levels of a binary trie with a 
single node of degree 21. See S. Nilsson and G. Karlsson, "Fast address lookup for Internet routers," in Proceedings 
of IEEE Broadband Communications 98, April 1998. This approach results in a very dense table, but again is not 
designed to support efficient updates. Another approach that compresses the trie, and thereby reduces the average 

75 number of memory accesses per search, is described by Tzeng. See H.H.-Y. Tzeng, "Longest prefix search using com- 
presses trees," in GLOBE-COM'98, Global Internet Mini Conference, pp. 88-93, November 1998. 
[0016] Lampson et al. propose a substantially different approach to the LMP problem by viewing it as a variation of 
binary search. See B. Lampson, V. Srinivasan, and G. Varghese, "IP lookups using multiway and multicolumn search," 
in Proceedings IEEE INFOCOM'98, pp. 1248-1256, 1998. Since a prefix represents a range of IP addresses, the prefix 

20 can be represented by two IP address-the smallest and the largest in the range. By sorting the (at most) 2p boundary 
addresses for p prefixes, we essentially define buckets of addresses where each address in the bucket has the same 
next hop. The approach is quite memory efficient, however insertion and deletion are relatively inefficient operations. 
[0017] Srinivasan and Varghese exploit the well-known technique of prefix expansion, which will reduce the number 
of memory accesses in a typical search at the cost of potentially increasing memory requirements and making updates 

25 of the forwarding table more difficult. See V. Srinivasan and G. Varghese, "Faster IP lookups using controlled prefix 
expansion," in ACM SIGMETRICS'98, pp. 1-10, June 1998. The paper's main contribution is the description of a formal 
approach based on dynamic programming to provide a way of searching that minimizes memory utilization. A similar 
scheme based on prefix expansion is described by Gupta et al. See P. Gupta, S. Lin, and N. McKeown, "Routing 
lookups in hardware at memory access speeds," in Proceedings IEEE INFOCOM'98, pp. 1240- 1247, 1998. Their 

30 approach, however, focuses on a proposed hardware implementation rather than optimality. 

[0018] The conventional approaches that have been discussed above are designed primarily to optimize lookup 
speed. In contrast to these approaches, Doe ringer et al.'s work on DP-Tries attempts to optimize forwarding table 
update speed as well as lookup speed. See W. Doeringer, Gunter Karjoth, and M. Nassehi, "Routing on longest-match- 
ing prefixes," IEEE/ACM Transactions on Networking, vol. 4, no. 1 , pp. 86-97, February 1996. Their approach is a vari- 

35 ation of the Patricia trie, with efficient insert and delete algorithms defined, as well as search. It is worth noting that more 
dynamic structures such as DP-Tries can be used to complement an approach that emphasizes lookup speed, by main- 
taining an up-to-date routing table that is accessed by the forwarding tables periodically. 

[0019] To accommodate the ever expanding needs of applications, specifically networking applications, a structure 
and method storing prefixes related to addresses is required that at least meets the following criteria: 

40 

• Efficient and scalable memory usage. 

• The structure should support efficient and simple^insert, delete, and search operations. 
45 • The structure should support a pipelined hardware implementation. 

II. SUMMARY OF THE INVENTION 

[0020] To solve the problems in the prior art it is in objective of the present invention to provide a way of storing pre- 
50 fixes related to addresses. It is a further objective of the present invention to provide a way of storing prefixes related to 
network addresses in a networking system. It is another objective of the present invention to provide a networking sys- 
tem that stores prefixes related to addresses in an efficient manner. It is yet another objective of the present invention 
to provide a computer program product that enables a computer associated with routers in a networking system to store 
prefixes related to addresses in an efficient manner. 
55 [0021 ] To meet the objectives of the present invention there is provided a method of storing a set of prefixes related 
to a set of addresses, said method comprising storing the prefixes in a binary the fashion wherein each node in said 
binary trie is associated with at least one of said prefixes and no node in said binary trie is empty. 
[0022] Preferably a first prefix is inserted into an empty trie by allocating a root node and placing said prefix in the 



A 
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root node. 

[0023] Preferably a prefix other than a first prefix, comprising k-bits, with a representation b 0 , ^.....b^ wherein k 
is an integer greater than 0, is inserted using a process comprising: designating a root node of said trie as a current 
node and b n = b 0 and the prefix as the current prefix; terminating insertion if the current node has the current prefix 
5 already stored in it; examining the current node's left child, if b n = 0 and examining the current node's right child if b n = 
1; allocating a new node and placing the current prefix if one of left child and right child do not exist, and designating 
said new node as the current node; assigning n=n+1 ; repeating until n=k; replacing a previously stored prefix in the cur- 
rent node with the current prefix and designating the previously stored prefix as the current prefix and repeating the 
steps. 

w [0024] Preferably the trie is searched for an LMP of an address comprising k-bits, with a representation b 0 , b h ...,b k _ 
1 wherein k is an integer greater than 0 using a process comprising: designating a root node as current node as well as 
an LMP node if the root node has a matching prefix and b n = b 0 ; designating current node as an LMP node and car- 
rying said LMP node lower if the current node has a matching prefix and if the matching prefix is longer than the LMP 
node; designating the current node's left child as the current node, if b n = 0 and designating the current node's right 

75 child as the current node if b n = 1 ; n=n+1 ; repeating the steps until the current node is at a lowest level of the trie; and 
selecting a prefix corresponding to said lowest trie as an LMP if said prefix is a match. 

[0025] Preferably, a prefix corresponding to an address is deleted in said the using a process comprising: searching 
for a matching node corresponding to said prefix; deleting the matching node if the matching node is a leaf node and 
terminating the process; deleting said matching node and moving up one of said matching node's children if said match- 
20 ing node is not a leaf node and deleting said one of said matching node's children; and repeating the steps until a leaf 
node is deleted. 

[0026] Preferably the trie is balanced for minimizing a depth in a worst-case search. 

[0027] Another aspect of the present invention is a method of converting a simple trie with stored addresses into a 
depth-optimal sub-trie that has all nodes representing addresses, said method comprising: finding a lowest level of said 
25 simple trie that has a full node and designating said lowest level as i, wherein i is an integer; examining each node at a 
level corresponding to M; moving up a prefix if there is an empty node at levei i-1 from a bottom of the deeper subtrie 
of the empty node; and continuing said merging until the root node is reached. 

[0028] Yet another aspect of the present inventions is a method of converting a simple trie, with stored addresses 
and known probabilities of visiting each node in said simple trie, into a search-optimal trie with a minimum number of 
30 expected steps per search, said method using dynamic programming and said method comprising: calculating an array 
for each node a using a bottom-up process such that AJi] holds a least expected number of search steps assuming 
i nodes are promoted out of a sub-trie with a as a root, wherein, 

A a P] = f(A p ,A 7 ,Pp,P r ) 

35 

0 and y are the left and right children of a; 

Pp and P y represent the probability that P and y are visited during a search assuming that a has been visited; asso- 
ciating with each A a [i] a number of prefixes that must be promoted from p and yto generate optimal subtries asso- 
40 dated with each AJi]; and working recursively top-down from the root to issue requests to child nodes to promote 
prefixes up, the root node requesting 1 prefix if the root node does not hold a prefix, the root node requesting 0 pre- 
fix if the root node holds a prefix, said requests being based on the array A and the associated numbers. 

[0029] Preferably the stored prefixes are related to Internet addresses and said trie is located in an IP router. 
45 [0030] Still another aspect of the present invention is a networking system comprising a plurality of routers, each 
router having an address storage, wherein in each address storage a set of prefixes related to network addresses cor- 
responding to the network system are stored in a form of a binary trie ,said binary trie comprising a plurality of nodes 
wherein each node is associated with a prefix of at least one of said network addresses and no node is said binary trie 
is empty. 

50 [0031] Preferably the binary trie is balanced for minimizing a depth in a worst-case search. 

[0032] Still another aspect of the present invention is a computer program product including a computer-readable 
medium, said program enabling one or more of computes associated with a networking system to store a set of 
addresses stored in each router within said networking system in a binary trie fashion wherein each node in said binary 
trie is associated with a prefix of at least one of said addresses and no node in said binary trie is empty. 

55 [0033] Preferably the computer- program product of claim 1 4 wherein said trie is balanced for minimizing a depth in 
a worst-case search. 

[0034] Still another aspect of the present invention is a system for storing a set of addresses in a binary trie fashion 
wherein each node in said binary trie is associated with a prefix of at least one of said addresses, wherein said system 
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comprises a pipeline, said pipeline further comprising a plurality of stages, each stage from said plurality of stages cor- 
responding to a level in said binary trie, said stage consisting essentially of a memory component, a bank of latches 
and a simple logic, said bank of latches storing a prefix, a destination IP address, a pointer ponting to an appropriate 
node, an instruction that indicates the task of the corresponding stage, and a state containing information about a state 
5 of the instruction. 

[0035] Preferably, each stage of said pipeline comprises latches holding input and output information, memory con- 
taining information corresponding to nodes at a level, a stack containing pointers to unused node addresses and com- 
parators. 

w III. LIST OF FIGURES 

[0036] The above objectives and advantages of the present invention will become more apparent by describing in 
detail preferred embodiments thereof with reference to the attached drawings in which: 

15 FIG.1 depits prefix distribution, no distribution, and depth optimal distribution for mae-west prefixes. 

FIG.2 shows a preferred embodiment of the present invention after the insertion of sequence (10011, 01100, 
1 1 1 1 ,01 00, 01 1 1 1 0, 1 01 00, 01 0, 0001 1 ). 

20 FIG .3 shows the preferred embodiment after the insertion of prefix 01 . 

FIG. 4 shows the preferred embodiment after the deletion of prefix 01 1 00 is. 

FIG.5 shows the preferred embodiment with the same prefixes as FIG.2 but with a different insertion sequence 
25 (0100, 01, 10011,000111, 010, 10100, 1111, 011110) 

FIG .6 shows two possible bonsai structures. 

FIG. 7 shows the merging of two depth optimal subtries. 

30 

FIG. 8 shows a search optimal subtrie. 

FIG.9 shows depth for random, depth optimal, and the search optimal subtrie. 
35 FIG.1 0 shows average node level for random, depth-optimal, and search-optimal bonsai. 

FIG.1 1 shows average comparisons per search for random, depth-optimal, and search-optimal bonsai. 
FIG.1 2 shows a distribution for the firat byte of the prefixes for the mae-east forwarding table. 

40 

FIG. 13 shows a distribution for the first byte of the destination IP addresses for the fix-west to trace. 
FIG.1 4 illustrates an example of a pipeline implementation of bonsai. 
45 FIG.1 5 shows an example of a search in stage i using the pipeline implementation of FIG.1 4. 
FIG. 16 shows an example of an insert in stage i using the pipeline implementation of FIG. 14. 
FIG. 17 shows an example of a delete in stage i using the pipeline implementation of FIG. 14. 

50 

FIG .1 8 shows an embodiment of a network system with routers storing prefixes related to addressed in an efficient 
manner according to the present invention, 

FIG. 19 shows an example of a conventional trie structure. 

55 

FIG. 20 shows an example of a conventional trie structure and an equivalent conventional Patricia trie structure. 
[0037] in terms of design objectives, the approach of the present invention has much in common with Doeringer et 
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al.'s DP-Tries, but there are several notable differences: 

• The algorithms for search, insert, and delete are considerably simpler than those for the DP-Tries. 

5 • Nodes in the present invention are relatively simple in comparison to the DP-Trie nodes. Each DP-Trie node 
requires three pointers to other nodes, two prefixes, and one index value that must be able to represent integers in 
the range of 0 up to the number of bits in an IP address. The nodes in the present invention contains one prefix and 
two pointers to other nodes. 

10 • DP-Tries in general have more nodes than the number of prefixes. These "overhead" nodes store information 
required to search the table. The present invention has no overhead nodes. 

[0038] The structure of a DP-Trie depends only on the prefixes in the table, not upon the ordering of the insertions 
and deletions of the prefixes. The structure of the trie used in the present invention is, in general, dependent on the 
15 insert and delete order. 

[0039] The advantages of the present approach include the following: 

• Memory usage is efficient and scalable. The bonsai uses only a single node for each prefix, with each node com- 
prising two node pointers and a prefix pointer. It is straightforward to store the nodes and the prefixes in arrays; 

20 therefore the pointer sizes can be restricted to Ig p bits where p is the number of prefixes stored. 

• The structure supports efficient and simple insert, delete, and search operations. If b is the number of bits in an IP 
address, the algorithms will require 0(b) time. 

25 • The way of storing prefixes according to the present invention is dependent on the sequence of insert operations. 
The present invention provides different optimally criteria. The first is a greedy algorithm that calculates the binary 
trie with minimum overall depth. The second is a dynamic programming approach that derives the bonsai trie with 
the minimal number of expected steps per search. This search-optimal bonsai approach can assume an arbitrary 
distribution of IP destination addresses. 

30 

• The present invention is particularly well suited for a pipelined hardware implementation. Throughput can be as 
high as one search (that is, one longest prefix match) per memory-access time. Inserts and deletes can be accom- 
plished with no more than two clock cycle stalls in the pipeline. 

35 [0040] Intuitively, the present invention is a variant of the trie approach. It eliminates nodes that are not associated 
with table entries by moving the prefixes in a trie upwards, until all nodes are associated with a prefix. Such an approach 
has two positive effects. First, it reduces memory usage. Second, it makes the trie more "shallow", potentially allowing 
for fewer memory lookups per search. As an example, FIG. 1 shows the trie prefix distribution, the trie node distribution, 
and the prefix/node distribution for the depth-optimal bonsai (discussed further in Section IVC.1) and for the mae-east 

40 forwarding table (discussed further is Section IVD). The levels of the trie are labeled from 0 (the root) to 32 (the maxi- 
mum length of a prefix). The present invention greatly reduces the number of nodes needed, further, prefixes are moved 
further up in the trie, reducing the number of steps per search. 

IVA. Bonsai 

45 

[0041] The preferred embodiment of the present invention, described herein, is named bonsai. Bonsai stores pre- 
fixes related to Internet addresses. The bonsai is a binary trie, where each node has an associated prefix. Insert, 
search, and delete operations, as well as certain implementation issues are discussed herein in detail. The bonsai has 
certain invariants which are presented here. Following is a proof showing that these invariants hold under the insert and 
so delete operations. 

Lemma 1 (Bonsai invariants) 

[0042] A bonsai has the following properties: 

55 

1 . The bonsai is a "packed" trie, in the sense that it contains only nodes that represent a routing-table entrie. 

2. All potential matching prefixes for an IP address can be found by descending the bonsai in typical the fashion, 



7 
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i.e., by using the ith bit of the IP address to choose the direction taken at level i of the bonsai. 
IVA.1 Insert 

5 [0043] When the first prefix is inserted into an empty trie, a root node is allocated and the prefix pointer of the node 
is set appropriately. Subsequent insertions follow their way down the the structure in the usual way, until the first free 
location is found. If a k-bit prefix with a binary representation of b 0 , b^.-.b^ is inserted, the algorithm starts at the root 
node. If b 0 = 0, the root node's left child is examined; otherwise the right child is examined. If no left (right) child exists, 
a node is allocated at that position and the prefix is placed there. If a left (right) child already exists, then bit b1 is exam- 

10 ined in the context of the child node. Only one copy of a prefix is allowed in the trie. If a duplicate copy is inserted, it will 
be found during the descent down the trie, and the current insertion will be stopped without modifying the trie. FIG. 2 
shows the status of the bonsai after a sequence of prefixes has been inserted. 

[0044] Not all prefixes will fall through the trie and become a leaf node, however. For example, consider insertion of 
the prefix 01 into the trie shown in FIG. 2. After following the 0-child of the node holding prefix 1 001 1 and the 1 -child of 

15 the node holding prefix 01 100, there is no way to go further down the trie. When a prefix x falls through the trie as far 
as it can and finds a node already there holding prefix y, prefix y is dislodged and allowed to fall further down the trie, 
just as if y were being inserted. Unless y equals x (in which case the insertion terminates), y will be longer than x and 
will therefore be able to fall further down the trie. Note that an insertion may cause numerous prefixes to be dislodged, 
but the procedure will require in the worst case only 0(d) operations where d is the depth of the trie. For example, FIG.3 

20 shows the state of the example trie after the 01 prefix has been inserted. The 01 prefix dislodges the 01 00 prefix, which 
falls two levels down in the trie where it generates a leaf node. 

IVA.2 Search 

25 [0045] Searching the bonsai given an IP address is relatively intuitive. One descends the trie in the usual way, as 
noted above in the section describing insertion. At each step of the descent, a comparison is made to see if the IP 
address is a match for the stored prefix. If so, and if that prefix is longer than any previously found match, a pointer to 
the node is carried along as lower levels of the trie are searched. An IP address may match several prefixes as it 
descends the trie, but all potential matches will be in its path. 

30 [0046] One consequence of this approach is that at each level of the trie, a comparison against the stored prefix is 
required. Such comparisons are not necessary for a pure trie approach, and will add a constant factor cost. 
[0047] Consider searching the bonsai in FIG.2forthe LMP of 01000000..., an IP address. At the root node there is 
no match with prefix 1001 1 . The 0-child node is visited, but there is no match with prefix 01 100. That node's 1 -child is 
visited, and there is a match with prefix 0100, so this prefix is remembered. Finally, that node's 0-child is visited, and 

35 again a match is found with prefix 010. However, this new match is shorter than the previous match. Since one can go 
no further down the trie, 01 00 must be the LMP. 

tVA.3 Delete 

40 [0048] As with insert and search, the delete operation involves a traversal down the trie, searching for matches 
against the prefixes. If the prefix to be deleted is resident at a leaf node, the prefix is deleted and the node is removed 
from the trie, requiring an update of one of its parent node's child pointers. If the prefix to be deleted is associated with 
a node that is not a leaf, however, care must be taken to maintain the trie structure. The key insight is that any prefix in 
the node's subtrie can replace the deleted prefix. Though there are many ways to select a replacement. One that will 

45 be easily pipelined is chosen in the present context. The prefix associated with a child node is moved up, and replaced 
with the prefix of one of its children, etc., until eventually a leaf node is reached. Then the leaf node (whose prefix has 
moved up to the parent node) can be deleted. In such cases, the prefixes can be viewed as "percolating" up the trie. 
Note that it is always a leaf node that is deleted. 

[0049] In the case where there are two children for a node, it will be possible to choose either the left or right child's 
so prefix to percolate up. (If a node has only one child, there is no choice.) When there is a choice, it is possible to use a 

static approach (e.g., the 0-child is preferred), or a more dynamic one (e.g., random selection). 

[0050] For example, consider deleting prefix 01 1 00 from FIG. 3. The process and resulting trie are shown in FIG.4. 

The process is started at the root node, no match is found with prefix 1 001 1 . 0-child of the root node is visited next, and 

a matching prefix to be deleted is found. Either the 0-child or the 1 -child prefix can be percolated. Assume that the 1- 
55 child is preferred and 01 percolates up. Thereafter, assume that the 0-child is preferred and 010 percolates up. This 

node has only one child, so 0100 percolates up. Since the leaf node has been reached, it is deleted. 
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IV.B Optimal Bonsai Tries 

[0051 ] One consequence of the bonsai operations is that the structure of the trie is dependent (in general) upon the 
order or the insert and delete operations. For example, the bonsai in FIG. 5 contains the same prefixes as the bonsai 
5 in FIG.2. However, the bonsai in FIG. 5 has a smaller average depth for the prefixes. It is therefore possible to manipu- 
late the trie to optimize some performance metric. For example, it may be desirable to balance the trie as much as pos- 
sible, so as to minimize the depth of the worst-case search. Or it may be desirable to minimize the depth of the average- 
case search. 

[0052] It is worth noting that minimizing the worst-case and the average-case search are conflicting criteria. For 
w example, consider the two small bonsai structures shown in FIG. 6. Assuming a uniform probability for all IP addresses, 
the expected number of comparisons to search trie (a) will be 2, since all searches will require exactly 2 comparisons. 
For trie (b), the expected number is (50%)(1) + (25%)(2) + (25%)(3) = 1 .75. 

[0053] Assuming uniform distribution, a unbalanced trie has better average-case search performance than the bal- 
anced trie. Of course, the uniform distribution assumption will not be valid in real routers. However, whenever the prob- 
15 ability distribution is known or can be estimated-for example, by tallying each time a node is accessed during a search- 
it will be possible to adjust the trie to optimize average-case behavior. Though calculation of optimal bonsai may be too 
time-consuming after each insert or delete operation, it may be reasonable to periodically restructure the bonsai so that 
it better meets the optimization criterion. 

[0054] In the following sections preferred embodiments of methods for calculating two different types of optimal 
20 bonsai is provided. The first is a greedy algorithm that calculates the bonsai trie with minimum overall depth. The sec- 
ond is a dynamic programming approach that derives the bonsai trie with the minimal expected number of search steps, 
based on an arbitrary distribution of destination IP addresses. 

[0055] Terminology related to the optimization methods is discussed herein. An empty node is a trie node that does 
^ ; not represent a routing-table entry. A full node does represent an entry. A subtrie consists of levels of nodes, where 

25 nodes of level i are i hops from the root of the subtrie. The root of the subtrie is the only node at level 0. Greek letters 
are used to represent nodes. The level of node is a labeled d a . The root node that this level is relative to should be clear 
from the context. If the root node of some subtrie is labeled a, it may also be used to represent the entire subtrie rooted 
at a; again, the meaning should be clear from the context. For any subtrie rooted at a, let w" represent the total number 
of prefixes at or below level i. w2 is called the weight of level i of the subtrie rooted at a. For example, if a is the root 

30 node of the full trie in FIG. 2, then wg = 8, w " = 7, wi = 5,W3 = 2, and w " =0 for all i > 4. Let p be the node with 
prefix 0100: then w[> =3,w? =2,andw § = 0 for all i > 2. When the subtrie is obvious from context Wj is also used to 
represent the subtrie. Finally, the depth of a subtrie is the level of its deepest node. 

IVB.1 Depth-Optimal Bonsai 

35 

[0056] A greedy algorithm is described herein that starts with a simple trie, compresses it by removing all nodes 
that do not represent a routing table entrie, and creates a bonsai with minimum depth and minimum average node (pre- 
fix) level. This preferred embodiment is called a depth-optimal bonsai. A depth-optimal subtrie is a subtrie such that no 
other subtrie with the same set of prefixes has a smaller Wj for any i. 

40 [0057] The algorithm works from the bottom up. From the basic trie structure for the routing table, including both 
empty and full nodes, depth-optimal subtries are recursively merged up. The lowest level of the trie where there is a full 
node is found. This is calledlevel i. (All nodes found at this level will necessarily be full.) Each node of the trie at level i 
- 1 is examined. (For a node to exist at any level in the trie, it must either be full or have at least one full descendant.) If 
a node at level i - 1 is full, no merging of subtries is possible and therefore no action is taken. If the node is empty, this 

45 implies that a prefix can be moved up (promoted) from one of its subtries, resulting in a depth-optimal subtrie rooted at 
level i - 1. In an arbitrary (full) node from the lowest level of the deeper subtrie is chosen to be promoted, as shown in 
FIG. 7. If both subtries have the same depth, a node is arbitrarily selected from the lowest level of either subtrie. This 
merging process continues up the levels of the trie until the root node is reached. 

so Lemma 2 (Depth-optimal subtrie invariants) 

[0058] Using the algorithm described above, each depth-optimal subtrie has the following properties: 

1. All prefixes in the subtrie have a common substring represented by the position of the subtrie root node within 
55 the trie, and ail prefixes that share the substring are in the subtrie. 

2. The subtrie is depth-optimal in the sense that it is impossible to rearrange the prefixes such that the level weights, 
wj, can be reduced. 



Q 
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[0059] Proof: Induction on the levels of the trie is used, beginning with level i, the level of the deepest (full) node in 
the original trie. 

[0060] Node a in level i must be full, and can have no children. In this case it is clear that the invariants of Lemma 
2 are maintained. It is now shown that all subtries rooted at level j - 1 maintain the invariants, assuming all subtries 

5 rooted at level j maintain them. Node a in level j - 1 will be either full or empty. 

[0061] If a is full, there is no variation on the structure of the subtrie rooted at a that allows for a lower Wj for any i. 
This is proven by contradiction. Assume there does exist a reorganization of the subtrie that would improve some Wj. 
This reorganization cannot involve moving the prefix associated with a to a lower level, since this would violate the first 
subtrie invariant; the prefix is already located at its lowest possible level. Therefore the reorganization must be accom- 

10 plished leaving the prefix associated with a in place. It is impossible to move a prefix from one subtrie to another, since 
the root nodes of the subtries represent distinct prefixes that cannot be nested. This implies that either the left subtrie 
or the right subtrie can be improved given its current prefixes, which contradicts the assumption that the merging sub- 
tries are depth-optimal. 

[0062] If a is empty, the algorithm selects a prefix, 8, from the lowest level of the deeper subtrie to take its position. 
75 Let P be the root of the left depth-optimal subtrie of a, and y be the root of the right depth-optimal subtrie of a. Without 
loss of generality, assume that subtrie p is deeper than y. By promoting 8, the resulting subtrie rooted at a will have w§ 
= 1, and 

w^w^+w^-1 

20 

for all i such that w A is greater than 0. In effect, the promotion of 8 has resulted in a left subtrie with level weight w ? 
reduced by one for each non-zero weight. To prove the resulting subtrie is depth-optimal, it must be shown that there is 
no other node, e , that can be promoted instead of 8 that can result in a superior subtrie. Assume e is in the subtrie 
rooted at p. For the promotion of e to be superior, the resulting left subtrie must have a level weight less than w ? - 1 
25 for some level j. Note, however, that insertion of a prefix can add at most 1 to any level weight. Thus, if one starts with 
the left subtrie without e and then inserted it, one would generate a new (complete) left subtrie with a level j weight less 
than w ^ . This violates the depth -optimality assumption for the left subtrie. Thus, no node will improve the subtrie more 
than promoting a prefix at the lowest level. A similar argument handles the case for when e is assumed to come from 
the right subtrie. 

30 [0063] A consequence of Lemma 2 is that the algorithm generates a bonsai trie that is depth-optimal in the sense 
described above. It can also be shown that the number of levels in the bonsai trie is minimized, and that the average 
depth of the nodes is minimized. 

IVB.2 Search-Optima! Bonsai 

35 

[0064] In this section, a preferred embodiment of a dynamic programming method that computes the bonsai trie 
with the minimum number of expected steps per search. The approach assumes an arbitrary distribution of destination 
IP addresses. The structure starts as a simple trie that is augmented such that the probability of visiting each node on 
any given search is known. (For example, the root node must be visited on every search, so its probability is set to 1.) 

40 In practice, this probability distribution is likely to change over time. However, a distribution can easily be estimated for 
any desired period of time by tallying the nodes that are visited in each search of the simple trie. 
[0065] Dynamic programming is useful here because the problem exhibits both optimal substructure and overlap- 
ping subproblems. See T. H. Cormen, C. E. Leiserson, and R. L. Rivest, Introduction to Algorithms. MIT Press, 1990. 
In this preferred embodiment one begins at the lower levels of the simple trie, and proceed upwards by promoting pre- 

45 fixes appropriately. However, the number of prefixes that must be promoted out of any subtrie will not be immediately 
known. The approach therefore uses in two phases. 

[0066] In the first phase, for each node, a, in the simple trie an array, k^, is calculated, [i] will hold the optimal 
(least) expected number of search steps for this subtrie, assuming i prefixes are promoted out of the subtrie. How large 
do these arrays need to be? Since a node can only promote prefixes to its direct ancestors, node a will never have to 

so consider the promotion of more than d a nodes. Therefore, values of AJi] in the range 0 < i < d a . It should be noted that 
there must be a special value for array elements that represents an infeasible number of promotions. For example, it is 
impossible to promote 4 prefixes from a subtrie that contains only 3 to begin with. During the calculation of these arrays, 
which is a bottom-up process, the number of prefixes that must be promoted from both the left and right subtries to gen- 
erate the optimal subtrie must also be retained. Once the arrays are calculated, the second phase works from the top 

55 down to discover the optimal structure and create the corresponding bonsai. Starting with the root node-which does not 
need to promote any prefixes-each node will issue requests to its left and right children to promote some number of pre- 
fixes and generate an optimal subtrie based on that number. 

[0067] Consider the first phase, which isthe calculation of the A arrays. FIG. 8 describes the basic situation. Label 
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the root node of the subtrie a, the left child p and the right child y. To calculate the knowledge of Ap and Ay is 
needed, as well as the probability that each child will be visited (assuming the root node has been visited), which are 
labeled p p and p y . (Note that if both the left and the right child exist, p p + p y will equal 1 .) 

[0068] First consider the case when node <x already contains a prefix. The subtrie structure corresponding to A„ [0] 
5 is straightforward; it is the case where no nodes are promoted out of either the left or right subtrie. 
A a [0] = 1 +PpAp[0]+p r A r [0] . For calculation of AJ1] there are two possibilities to consider. Promotion of 1 from the 
left and 0 from the right, or promotion of 0 from the left and 1 from the right. The best choice depends on which value 
is smaller, ppAptlJ+p^O] or ppAptOJ+p^l]. This procedure continues until ail required values of are calculated. 
In general: 

10 

A Ji] = 1 + min {p , A p [/] + p y A, [k] } 

15 

within the range 0 < i < da. Again, the j and k value that generated the minimal AJi] should also be retained. 
[0069] In this case where a is empty, the need to promote a prefix into a as well as promote prefixes above a. Even 
promoting zero prefixes from a will require promotion of one prefix from one of the two subtries; the best choice 
depends on which value is smaller, PpAp[1]+p r Ay[0] or PpA p [0]+p y ,A 7 [1]. In general: 



AJil^l+minfepA^L/l + ^A.W} 

25 

within the range 0 < i < d a . 

IV.C Experimental Results and Analysis 

30 [0070] In the experiments, Internet forwarding tables made available at the Internet Performance Measurement and 
Analysis (IPMA) web site is used. See Internet Performance Measurement and Analysis Project (IPMA). Available at 
http://nic.merit. edu/lpma/. These forwarding tables, which are updated daily, have become standards for IP forwarding 
experiments. The data used here is from 17 August 1998. In order to simulate a realistic distribution of IP datagram des- 
tinations, a trace of real datagrams destination IP addresses from fix-west is used. The trace contains 2,146,573 

35 addresses (five-minutes' worth), recorded on 22 February 1 997. This trace is made available by the National Laboratory 
for Applied Network Research (NLANR). See National Laboratory for Applied Network Research (NLANR). Available 
at http://ww.nlanr.net/NA/. It is to be noted that this trace was not gathered from the routers whose forwarding tables are 
available at the IPMA page. 

[0071] Four metrics for the bonsai are considered: 

40 

• the depth, 

• the average level of a node/prefix, 

45 • the expected number of steps (or comparisons) per search, assuming a uniform distribution of destination IP 
addresses, and 

• the expected number of steps per search, assuming the distribution of destination IP addresses defined by the fix- 
west trace. 

50 

[0072] Table 2 provides some description of the routing tables for the five locations. For each site, the number of 
prefixes in the table equal to the number of nodes in the bonsai are listed. Also listed are the hit rate and miss rate for 
the fix-west trace relative to the given forwarding table. As discussed earlier, the trace is not associated with the forward- 
ing tables, creating the possibility of a significant fraction of misses. 



11 
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Site 


Prefixes 


| Trace Statistics 


1 Hit Rate 


Miss Rate 


aads 


24325 


37.63% 


62.37% ! 


mae-east 


41123 


95.68% 


4.32% 


mae-west 


19260 


69.43% 


30.57% 


paix 


4241 


6.33% 


93.67% 


P b 


22830 


30.83% 


69.17% 



Table 2: Metrics for routing tables at five locations, 17 August 1998. Hit rate 
and miss rate for five minutes of destination IP addresses from fix-west around 
noon, 22 February 1997. The trace contains 2,146,573 IP datagrams. 



[0073] Table 3 contains information for 100 bonsai where the prefixes are inserted in random order. For each met- 
ric, we show the minimum, average, and maximum values. Fairly consistent behavior for all the routers is noted, with 
the numbers for paix typically being somewhat smaller, due to the fact that it holds fewer prefixes. The bonsai have a 

20 typical depth of around 24, while the average level of a node is approximately 1 8 for the large tables. Also note that the 
average number of comparisons per search is much smaller for the uniform distribution than for the fix-west trace. This 
is because the uniform distribution assumes a large percentage of destination addresses in very sparse areas of the 
bonsai, where there are few possible matches. This phenomenon^ discussed in more detail later in this section. 
[0074] Metrics for the depth-optimal bonsai are listed in Table 4. In all cases the depth-optimal bonsai is more shal- 

25 low than the best of the 1 00 random bonsai. The depth-optimal bonsai will also have the smallest average node level. 
Interestingly, the depth-optimal bonsai is worse than the average random bonsai in terms of comparisons per search. 
Intuitively, this occurs because the deep nodes, of the trie, while they can add to the depth, are less likely to be visited 
during a search than nodes higher up in the trie. 

[0075] Table 5 contains data for the search-optimal bonsai. For this optimization, the depth and the average node 
30 level are worse than for the random bonsai, but we make real gains in terms of comparisons per search. Again, this indi- 
cates the tradeoff between depth and search time. 

[0076] To facilitate direct comparisons between the different bonsai approaches, bar graphs for depth (FIG. 9), 
average node level (FIG. 1 0), and average comparisons per search for the fix-west trace (FIG. 1 1 ) are included. It is to 
be noted that the depth-optimal bonsai has modest but consistent advantages compared to other approaches for both 
35 depth and average node level: improvements in depth relative to random insertion range from 4% to 11%, while 
improvements in average node level range from 1% to 2%. It should also be noted that the search-optimal bonsai is 
worse than the average random bonsai for these metrics. 



19 
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Site 


| Depth 


Avg Level 




mia 


avg 


max 


min 


avg 


max 


aads 


24 


24.02 


25 


17.46 


17.47 


17.48 


mae-east 


24 


24.05 


25 


18.17 


18.18 


18.18 


mae-west 


24 


24.02 


25 


17.12 


17.13 


17.14 


paix 


23 


23.53 


24 


15.10 


15.13 


15.15 


Pb 


24 


24.01 


25 


17.46 


17.47 


17.48 




Avg Compe 


(Uni) 


Avg Comps (Thee) 




mm 


avg 


max 


min 


avg 


max 


aads 


7.05 


7.08 


7.10 


16.53 


1636 


17.17 


mae-east 


756 


7.50 


7.52 


17.70 


1757 


18.25 


mas-vest 


7.09 


7.12 


7.15 


16.63 


17.02 


17.37 


paix 


5.64 


5.90 


5.93 


13.23 


13.43 


13.54 


pb 


6.98 


7.04 


7.05 ] 


16.54 


16.73 


17.04 



Tfcble 3: Statistics for 100 bonsai for each location. Prefixes were inserted in 
random order. 



Site 1 


I Depth 


Avg 


Avg Comps 


Avg Compe 






Level 


(Uniform) 


(Trace) 


aads J 


23 


17.25 


7.13 


17.04 


mae-east 


23 


17.98 


7.56 


18.11 


mae-west 


23 


1650 


7.18 


1650 


paix 


21 


1488 


5.95 


1353 


Pb 


I 23 


1754 


7.08 


1653 



Thbie 4: Statistics for depth-optimal bonsai for each location. 



Site 1 


Depth 


Avg 


Avg Comps 


Avg Comps 






Level 


(Uniform) 


(Trace) 


aads 


25 


1751 


6.62 


1458 


mae-east 


25 


18.58 


750 


15.66 


mae-west 


25 


17.57 


6.94 


1454 


paix 


25 


15.68 


5.52 


1257 


Pb 


25 


17.91 


6.85 


1455 



Table 5: Statistics for search-optimal bonsai (relative to the Trace distribution) 
for each location. 



[0077] The data on the average number of comparisons per search, however, shows the advantages of the search- 
optimal bonsai. Improvements relative to the average random bonsai range from 9% to 13%. It should also be noted 
that the depth-optimal bonsai performs relatively poorly for this metric, though it does slightly outperform the random 
bonsai for the mae-west forwarding table. 

[0078] In general the results suggest that random insertion of prefixes will provide reasonable performance for all 
the metrics considered. 

[0079] There are several caveats related to the interpretation of these experimental results. For one thing, the trace 
is not taken from the routers that are examined but from a completely separate location. The extent to which the trace 
provides a realistic distribution is therefore debatable. However, when the effect on performance is considered, misses 
are not necessarily problematic, since even misses require a full bonsai search. In other words, misses are not neces- 
sarily performance outliers. 



EP 1 063 827 A2 

[0080] Another issue is that there are certain peculiarities related to the assignment of IP addresses that can affect 
performance. For example: 

• The forwarding tables have no entries for either Class D IP addresses (which begin with "1110" and are used for 
5 multicast) or class E IP ad-dresses (which begin with "11 1 1 0" and are reserved for future use). 

• The fix-west trace has no class E addresses, but 25,719 destination ad-dresses are in class D (approximately 
1.2%). 

w • The uniform distribution assumes Class D and Class E addresses are possible, with frequencies of approximately 
6.3% and 3.1%, respectively. 

Since the bonsai will contain no prefixes for Class D or Class E addresses, it will not have a node at or below locations 
"1 1 1 0" and "1111 0". In fact, only Class D or E addresses can start with "111". Thus, Class D and E searches are faster 
15 than average-at most 3 levels of the bonsai will be searched. Similar effects can be seen in other areas of the address 
space: none of the forwarding tables contains a prefix that begins with "111" or "01 0", and each table contains only one 
prefix that begins with "01 1 ". (The entrie that begins with "011" is in all cases 127/255, which is reserved for loopback 
testing.) 

[0081] In light of the importance of prefix and IP destination address distributions, it is worthwhile examining real 
20 forwarding tables and real traces. FIG. 1 2 shows the distribution of prefixes from the mae-east forwarding table, based 
on the dotted decimal notation of the first byte of the prefix. Both linear and logarithmic scales are shown. The data 
shows that class C prefixes are far more common than others. There are very few Class A addresses, while the Class 
B addresses are fairly evenly distributed within a certain range. Again, these distributions have important consequences 
for trie-based approaches. The left side of a bonsai, for example, will be very sparsely populated in comparison to the 
25 right side. And similar arguments hold further down the trie. 

[0082] FIG. 13 shows the distribution for the first byte of the destination IP ad-dresses for the fix-west trace. The 
data shows again that a uniform distribution is not a good model of the traffic. Traffic for Class B and Class C is far larger 
than for Class A. In fact, two bytes-128 and 192 in decimal notation-account for more that one third of ail destination 
addresses. 

30 

IVD. Pipeline implementation 

[0083] Though the discussion so far has implicitly focused on a software implementation, the preferred embodiment 
bonsai also lends itself to dedicated hardware implementation. Through-put can be as high as one search permemory- 

35 access time. Inserts and deletes can be accomplished with no more than two clock cycle stalls in the pipeline. In this 
section, a preferred embodiment of pipeline implementation of bonsai is presented. It should be noted, the pipelining 
method is not restricted to bonsai. Many LMP search approaches can be pipelined in a similar manner. Gupta et al. pro- 
vide one example-but for many of these approaches inserts and deletes are problematic. See P. Gupta, S. Lin, and N. 
McKeown, "Routing lookups in hardware at memory access speeds," in Proceedings IEEE INFOCOM'98, pp. 1240- 

40 1247,1998. 

[0084] Consider FIG. 1 4, which shows a abstract pipeline for a bonsai. A pipeline stage consists of a memory com- 
ponent, some simple logic, and a bank of latches. The simplest implementation would handle one level of the bonsai at 
each stage, requiring d stages for a depth-d bonsai, (to reduce the number of stages it can be helpful to construct the 
depth-optimal bonsai.) At the input to stage 0, the destination IP address is sent for a search or the prefix for an insert 
45 or delete. Small instruction code to allow the pipeline to distinguish between searches, inserts, and deletes is also sent. 
[0085] For the purposes of this discussion, assume the pipeline has one stage for each level of the bonsai. The data 
in level i of the bonsai will be stored in stage i of the pipeline. The latches before each stage will store the following infor- 
mation: 

so • A prefix, P, used as an input for inserts and deletes and an output for searches. 

• A destination IP address, D, used as an input for searches. 

• A pointer, Ft, which points to the appropriate node in the current level. 

55 

• An instruction, I, which indicates whether this stage of the pipeline is doing a search, an insert, or a delete. 

• A state, S, which contains information about the state of the current instruction. For example, during a search one 
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may need to know if an previous matches have been found, or during a delete one may be promoting prefixes at 
this point rather than deleting. 

The basic hardware for each stage of the pipeline will include the following: 

5 

• Latches that hold relevant input and output information, as described above. 

• Memory that contains information on the nodes of the level. Nodes are of fixed size, and contain a prefix and two 
pointers. When writing to a node, it is possible to write just to a node's prefix or to one of its two child pointers. 

10 

• A stack (or some other structure) that contains pointers to unused node addresses in the subsequent stage. For 
example, during an insert, some node will need to allocate memory for a child. Similarly, during a delete, some 
node will have to deallocate memory for a child. Memory management is quite simple due to the fixed size of the 
nodes. 

75 

• Comparators, for example to check prefix matches or compare prefix lengths. 

• A variety of more basic building blocks, such as multiplexers and logic gates. 

20 [0086] It is to be noted that although subsequent instructions in the pipeline are independent, it will be necessary 
to stall the pipeline in some cases. These can occur only during inserts or deletes, however, and will never cause more 
than 2 clock cycle stalls. 

[0087] Though an exhaustive description of the pipeline design is inappropriate here, the hardware required for 
some specific cases is examined, to provide a feel for the design requirements. FIG. 15 shows a detailed example of 
25 potential operation during a search. At this point, assume that the relevant node at stage i exists, and that another rel- 
evant node exists at stage i + 1 . It is checked to see if the destiantion IP address matches the prefix in stage i. If the 
prefix does match, and if it is longer than any earlier matches, it will be passed along to the next stage, along with the 
appropriate pointer for the next node. 

[0088] The simple case for an insert occurs when an inserted prefix falls into the first empty node. This can be 
30 accomplished with a single stall in the pipeline, which is required to write a new pointer into the parent of the new leaf 
node. FIG. 16 shows this case. First, the memory is read, and it is found that there is no appropriate child node. A 
pointer is allocated at the pointer stack for the new node. This pointer is written back into the memory (during the sec- 
ond clock cycle), and it is also passed on to the subsequent stage, along with the prefix to be inserted. Another case 
occurs when an insert causes another prefix to be dislodged, if a prefix is dislodged in stage i, this will require two mem- 
35 ory accesses at stage i: a read of the prefix to be dislodged, followed by a write of the prefix to be inserted. This can be 
accomplished with one stall of the pipeline. Note,t.hat even if more prefixes are dislodged for this insert further down the 
pipeline, no more stalls will be necessary. 

[0089] Deletes are more difficult since a deleted prefix in level i will require a pointer update in level i - 1, which will 
require bypass hardware between stages. Level i can be read during clock cycle j. Level i - 1 can be written during clock 

40 cycle j + 1 (note that the pointer to the parent node must have been saved in the latches). In general, the children of the 
deleted prefix need also to be promoted. Stage i + 1 can be read in clock cycle j + 1 , and written back to stage i during 
clock cycle j + 2. The beginning of this action is shown in FIG. 1 7. It is found that there is no match in stage i. It should 
be noted that a child exists, so a prefix needs to be promoted. The bypass hardware needed for the write-back is not 
shown for clarity. In the worst case, deletes will force two clock cycles of stall. 

45 [0090] One difficulty with this design is the imbalance in the number of nodes per bonsai level, which corresponds 
to an imbalance in the memory sizes needed by the pipeline stages. FIG.1 shows, for example, that some levels have 
no nodes while others have thousands. It should be fairly easy to split one level of a bonsai over several contiguous 
pipeline stages when the memory requirements of a single stage are insufficient, but it is still the case that the levels 
near the root will only require a very limited amount of memory. 

50 

IVE. A Network System using Bonsai 

[0091] FIG. 1 8 shows an implementation of a preferred embodiment of a network system according to the present 
invention. This network system comprises a plurality of hosts 18.10-18.13. Each host has routers 18.20-18.23 associ- 
55 ated with it. Prefixes of addresses are stored in the routers using bonsai tries. Bonsai tries, as noted above, are imple- 
mentations of binary tries wherein prefixes related to addresses are storesuch that each node in the bonsai trie has a 
prefix stored and no node is empty. 

[0092] Other modifications and variations to the invention will be apparent to those skilled in the art from the fore- 
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going disclosure and teachings. Thus, while only certain embodiments of the invention have been specifically described 
herein, it will be apparent that numerous modifications may be made thereto without departing from the spirit and scope 
of the invention. 

5 Claims 

1. A method of storing a set of prefixes related to a set of addresses, said method comprising storing the prefixes in 
a binary trie fashion wherein each node in said binary trie is associated with at least one of said prefixes and no 
node in said binary trie is empty. 

10 

2. The method of claim 1 wherein a first prefix is inserted into an empty trie by allocating a root node and placing said 
prefix in the root node. 

3. The method of claim 1 or 2, wherein a prefix other than a first prefix, comprising k-bits, with a representation b 0 , 
is b^...,^.-, wherein k is an integer greater than 0, is inserted using a process comprising: 

a) designating a root node of said trie as a current node and b n = b 0 and the prefix as the current prefix; 

b) terminating insertion if the current node has the current prefix already stored in it; 

20 

c) examining the current node's left child, if b n = 0 and examining the current node's right child if b n = 1 ; 

d) allocating a new node and placing the current prefix if one of left child and right child do not exist, and des- 
ignating said new node as the current node; 

25 

e) assigning n=n+1 ; 

f) repeating steps b-e until n=k ; 

30 g) replacing a previously stored prefix in the current node with the current prefix and designating the previously 

stored prefix as the current prefix and repeating steps b-g. 

4. The method of claim 1 or 2, wherein said trie is searched for an LMP of an address comprising k-bits, with a repre- 
sentation b 0 , b-i,...,^.-, wherein k is an integer greater than 0 using a process comprising: 

35 

a) designating a root node as current node as well as an LMP node if the root node has a matching prefix and 

b) designating current node as an LMP node and carrying said LMP node lower if the current node has a 
40 matching prefix and if the matching prefix is longer than the LMP node; 

c) designating the current node's left child as the current node, if b n = 0 and designating the current node's right 
child as the current node if b n = 1 ; 

45 d) n=n+1 ; 

e) repeating steps b-d until the current node is at a lowest level of the trie; and 

f) selecting a prefix corresponding to said lowest trie as an LMP if said prefix is a match. 

50 

5. The method of claim 1,2,3, or 4, wherein a prefix corresponding to an address is deleted in said trie using a proc- 
ess comprising: 

a) searching for a matching node corresponding to said prefix; 

55 

b) deleting the matching node if the matching node is a leaf node and terminating the process; 

c) deleting said matching node and moving up one of said matching node's children if said matching node is 
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not a leaf node and deleting said one of said matching node's children; and 

d) repeating step b-c until a leaf node is deleted. 

The method of anyone of claims 1 to 5 wherein said trie is balanced for minimizing a depth in a worst-case search. 

A method of converting a simple trie with stored addresses into a depth-optimal sub-trie that has all nodes repre- 
senting addresses, said method comprising: 

a) finding a lowest level of said simple trie that has a full node and designating said lowest level as i, wherein i 
is an integer 

b) examining each node at a level corresponding to i-1 ; 

c) moving up a prefix if there is an empty node at level i-1 from a bottom of the deeper subtrie of the empty 
node; and 

d) continuing said merging until the root node is reached. 

20 8. A method of converting a simple the, with stored addresses and known probabilities of visiting each node in said 
simple the, into a search-optimal the with a minimum number of expected steps per search, said method using 
dynamic programming and said method comprising: 

a) calculating an array Aq for each node a using a bottom-up process such that AJi] holds a least expected 
25 number of search steps assuming i nodes are promoted out of a sub-trie with a as a root, wherein, 

A 0 p] = f(A p ,A yl P pi P T ) 

p and y are the left and right children of a; 

30 

Pp and P T represent the probability that p and y are visited during a search assuming that a has been vis- 
ited; 

b) associating with each AJi] a number of prefixes that must be promoted from p and y to generate optimal 
35 subtries associated with each AJi]; and 

c) working recursively top-down from the root to issue requests to child nodes to promote prefixes up, the root 
node requesting 1 prefix if the root node does not hold a prefix, the root node requesting 0 prefix if the root 
node holds a prefix, said requests being based on the array A and the associated numbers of step b. 

40 

9. The method of anyone of claims 1 to 8 wherein said addresses are Internet addresses and said trie is located in an 
IP router. 

10. A networking system comprising a plurality of routers, each router having an address storage, wherein in each 
45 address storage a set of prefixes related to network addresses corresponding to the network system are stored in 

a form of a binary trie, said binary trie comprising a plurality of nodes wherein each node is associated with a prefix 
of at least one of said network addresses and no node is said binary trie is empty. 

11. The system of claim 10 wherein said binary trie is balanced for minimizing a depth in a worst-case search. 

50 

12. A computer program product including a computer-readable medium, said program enabling one or more of com- 
puters associated with a networking system to store a set of addresses stored in each router within said networking 
system in a binary trie fashion wherein each node in said binary trie is associated with a prefix of at least one of 
said addresses and no node in said binary trie is empty. 

55 

13. The computer-program product of claim 12 wherein said trie is balanced for minimizing a depth in a worst-case 
search. 
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14. A system for storing a set of addresses in a binary trie fashion wherein each node in said binary trie is associated 
with a prefix of at least one of said addresses, wherein said system comprises a pipeline, said pipeline further com- 
prising a plurality of stages, each stage from said plurality of stages corresponding to a level in said binary trie, said 
stage consisting essentially of a memory component, a bank of latches and a simple logic, said bank of latches 
storing a prefix, a destination IP address, a pointer pointing to an appropriate node, an instruction that indicates the 
task of the corresponding stage, and a state containing information about a state of the instruction. 



15. The system of claim 1 4 wherein each stage of said pipeline comprises latches holding input and output information, 
memory containing information corresponding to nodes at a level, a stack containing pointers to unused node 
addresses and comparators. 
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